Order 1 autoregressive process of finite length 
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The stochastic processes of finite length defined by recurrence relations request additional relations 
specifying the first terms of the process analogously to the initial conditions for the differential 
equations. As a general rule, in time series theory one analyzes only stochastic processes of infinite 
length which need no such initial conditions and their properties are less difficult to be determined. 
In this paper we compare the properties of the order 1 autoregressive processes of finite and infinite 
length and we prove that the time series length has an important influence mainly if the serial 
correlation is significant. These different properties can manifest themselves as transient effects 
produced when a time series is numerically generated. We show that for an order 1 autoregressive 
process the transient behavior can be avoided if the first term is a Gaussian random variable with 
standard deviation equal to that of the theoretical infinite process and not to that of the white noise 
innovation. 



I. INTRODUCTION 

The purpose of the statistical processing of time series 
is to find a stochastic model which can generate time se- 
ries having the same statistical properties as the observed 
series. One of the most common statistical model is 
the autoregressive moving average (ARMA) process hav- 
ing many applications in economy, finance, signal theory, 
geophysics, etc. [l|. Lately, especially the applications of 
the autoregressive (AR) models have become more fre- 
quent in physics as well. For example they are used in the 
analysis of the wind speed fluctuations [2], radar signals 
^] , climatic phenomena variability ^ , electroencephalo- 
graphic activity heart interbeat time series the 
daily temperature fluctuations 0, X-ray emmision from 
the active galactic nuclei @, sunspots variability [9], etc. 
As a result of their simple mathematical properties and 
their direct physical interpretation, the realizations of 
AR(1) processes have been used as artificial series to an- 
alyze some numerical algorithms for monotonic trend re- 
moval [10], some surrogate data test for nonlinearity [llj 
or for renormalization group analysis [T^ l . 

A stochastic process {Xt,t = 0,±1,±2, ...} is called 
autoregressive process of order p, denoted AR(p), if {Xt} 
is stationary and for any t we have 



kXt-i 



4>pXt-p — Zt 



(1) 



where {Zt} is a Gaussian white noise with zero mean and 



variance a 



and 



are real constants. The 



above relation may be rewritten in the compact form 
(l,{B)Xt = Zt where 



1 



(2) 



and B is the shift operator, BXt — Xt-i. Equation 
(HI) has a unique solution if the polynomial ^ does not 
vanish for \z\ — 1 [l^. If in addition (j){z) ^ for all 
l^l < 1, then the process is causal, i.e., there exists a 
sequence of constants {tpj} such that J^'jLi < °° 



and 



Xt 



oo 

E 

3=0 



t = Q,±l,. 



(3) 



Hence, a causal process is characterized by the property 
that the random variable Xt can be expressed only in 
terms of noises at previous moments and at the same mo- 
ment. The properties of AR(p) processes have been stud- 
ied in detail and they are the basis of the linear stochastic 
theory of time series ([ll, [p, [Ts'l). 

The stochastic process defined above is an idealized 
mathematical object which has no direct correspondent 
in practice. Each time series obtained by measurements 
is a sequence of real numbers Xt and one makes the as- 
sumption that each of those numbers is a realization of 
a random variable Xf. To recover the statistical infor- 
mation regarding the stochastic process we need a large 
number of time series generated in the same conditions, 
a situation occurring rarely in practice. Usually we have 
only one single time series and the recognition of the 
stochastic process that generated it is very difficult. In 
addition the finite length (sometimes very short) of the 
data series render the problem even harder. Therefore it 
is important to analyze a finite stochastic process satisfy- 
ing the same recurrence relation as the idealized infinite 
stochastic process ([ij. 

In the following we analyze the properties of an AR(1) 
stochastic process of finite length allowing us to make de- 
tailed analytical and numerical computations. We com- 
pare the results obtained with the ideal case of the infinite 
stochastic process and we discuss the conclusions which 
can be obtained from its power spectrum. 



II. AR(1) PROCESS 

A stochastic AR(1) process is defined by the simplified 
form of the relation ([T]) 



Xt = <l)Xt-i + Zt 



(4) 
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By definition an AR(1) process has an infinite length. In 
this case the polynomial ^ has the form (l){z) = 1 — 
and then the causality condition reduces to \(j)\ < 1. 
Because the relation ^ is so simple, we can analyze more 
directly the significance of this condition. By successively 
applying ^ r times we obtain 



Xt^Zt + cbZt-i 



(5) 



Because the process {Xt} is stationary, the random vari- 
ables Xt and Xt-T have the same norm and then the 
norm of the last term in ^ is 0'^ times the norm of the 
left term. So for any positive number e < 1, there exists 
T > Ine/ In |0| > such that the last term from the right 
side can be neglected 



Xt = Zt+ (pZt-i 



r+1 



+ (6) 



for e ^ 0. This is the definition relation of a causal pro- 
cess ([3|) where '0j = ■ From relation ([6|) one observes 
that the influence of the noise reduces as the time moves 
away from t. 

In the nonstationary case |0| = 1, all the terms in 
(ini) have unitary coefficients and for any delay r none of 
them can be neglected. Every random variable Xt is an 
infinite sum of terms with the same norm, hence its norm 
is infinite. 



A. Causal AR(1) process 

In the following we analyze the basic properties of the 
causal stationary process AR(1) using the relation If 
we take the mean of this relation we obtain E {Xt} — 0. 
Its square is 



2(/)Xt_iZt + Zl 



In accordance with relation ([S]) the random variables 
Xt-\ and Zt are independent, that is E {Xt-iZt} — 0. If 
we take the mean of the last relation we obtain a relation 
between the variance of successive random variables 

2 i2 2 ,2 

Because the AR(1) process is stationary, it follows that 
for every t we have the same value for the variance at = 
(7, and then 



(7) 



1 - 



In order to compute the autocovariance function we 
multiply (HI) with Xt-r and we take the mean. Because 
the mean of Xt vanishes and E {Xt-iZt} = 0, we obtain 

^ (t) = E {XtXt-r} ^ (1^1 {t~1). 

By applying successively this relation and taking into ac- 
count that 7 (0) — cTg, we have 



The spectral density is the Fourier transform of the au- 
tocovariance function 



oo 

- y 



-I'KITV 



7(t) , 



(9) 



where the positive number v is the frequency. By direct 
calculation with 7 (r) given by ([8|) we obtain 



1 



27r 1 — 2(/)COs27ri/ 



(10) 



Due to the periodicity of this function, we reduce its do- 
main of definition to the interval v g [0, 0.5]. 

When (/) ^ 1, the standard deviation given by ([7]) 
and the covariance function 7(t) given by ([5]) become 
both of them infinite. The spectral density (fTO]) becomes 
infinite only for v = Q. 



B. Acausal AR(1) process 

Let us analyze the basic properties for the stationary 
acausal AR(1) process, that is when |0| > 1 in ([5]). The 
relation ([S]) is no more true because now 0'^ increases 
when T increases. If we divide ([5]) by 0"^, then 



^Xt 



'Zt 



'Zt 



-Xt- 



For every positive e < 1, there exists t > — lne/ln|(/)| > 
such that the term from the left side can be neglected 
and then 



Xt-T 



-<f> Zt-r + 1 



-r+1 



Zt-1 



4>-^Zt + 0{e) 
(11) 

for e ^ 0. Hence, the random variable at moment t — t 
can be expressed in terms of the noise values at the future 
moments. It means that the direction of this process is 
reversed to that of the causal process ([3|) . 

The same conclusion can be drawn from ^ if we write 
it in the form 



Xt-i 



'Xt 



In this way we obtain a stationary causal process AR(1) 
because \4>~^ \ < 1, but in reverse temporal direction and 
with the variance of the noise (p^^a. It means that the 
formulas for the acausal AR(1) process can be obtained 
from those for the causal one by replacing (f> with and 
a with (f)~^(T. We shall derive these formulas directly as 
well in order to verify this assertion. 

From pT|) it follows that the random variables Xt-i 
and Zt are not independent, that is E {Xt-iZt} ^ 0. In 
this case E {XfZt} = 0, and then we write ^ in the 
form 



cl^Xt 



Xt 



and we square it 



2j.r 



(8) 



'Xt 



2XtZt + Zl 
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If we take the mean instead of ([7]) we obtain 

„2 



' 02 - 1 

In order to compute the autocovariance function we mul- 
tiply dH) by XtJ^r and instead of (O we obtain 

Finally, relation (|10|) is the same. 



C. Anticorrelated AR(1) process 

Let us remark that the values of the parameter can 
be both positive and negative. In order to qualitatively 
characterize the difference between the two situations we 
use the fact that, if (/> = 0, the AR(1) process is reduced 
to a white noise with uncorrelated terms and a vanishing 
autocovariance function for r > 0. When > 0, from 
(III) it follows that the fluctuations due to the white noise 
are superposed over the term which memorizes 

a part of the previous value of the time series. Hence, 
the larger (/> is, the closer from each other the successive 
values of the time series are, and the fluctuations due 
to the white noise are smaller. Therefore, in comparison 
with a realization of a white noise, for (/> > the graph- 
ical representation of an AR(1) process is less fluctuant 
and resembles to a deterministic trajectory disturbed by 
a random fluctuation (see Fig. [1]). The autocovariance 
function ([5]) is positive and tends to zero for r — > oo. 

If < 0, then the white noise is superposed over the 
term — |(/)|Xt_i which has an opposite sign to the previous 
term of the time series. Consequently the white noise 
fluctuations are enhanced and the series values fluctuate 
with a larger amplitude than the white noise, as shown 
in Fig. [T] The successive values of the autocovariance 
function ([5]) are of opposite signs and the time series is 
called anticorrelated. 



III. AR(1) POWER SPECTRUM 

In Fig. [2] we have plotted the power spectrum PH)) for 
(/i = 0.5 and ct = 1 on a linear scale and on a log-log one. 
The logarithmic coordinates strongly distort the shape of 
the graphic because by taking the logarithm, the origin 
of the Ox axis is send to — cx) and any neighborhood of 
the origin is transformed into an inflnite length interval. 
We have separated the graphic into three regions (A, B, 
and C) in order to evidence the deformations. For small 
frequencies (region A) the spectral density is strongly 
stretched such that a plateau appears with a value given 
by 



/(O) 



27r(l 



(12) 



From relation ([TO]) one observes that the plateau corre- 
sponds to the small values of when the variable term 
at the denominator can be neglected in comparison with 
the constant term. Using the quadratic approximation 
for cosine function we obtain the condition that the graph 
of the AR(1) power spectrum has a plateau 



1 



(13) 



One remarks that if tends to 1, then the plateau ap- 
pears at smaller values of the frequency. 

The region C of the spectral density for large frequen- 
cies is almost parallel to the Ox axis in linear coordi- 
nates. In logarithmic coordinates it is strongly squeezed 
and acquires a significant slope. The region B of median 
frequencies is not compressed so much, but its almost 
exponential shape in linear coordinates becomes o curve 
with a considerable part having a constant slope. The 
relative length of the three frequency regions depends on 
the minimum value i^min of the frequency scale in the 
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FIG. 2: The power spectrum of an AR(1) process for — 0.5 and a = 1 on a linear scale and on a log-log one. 
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FIG. 3: Power spectra of an AR(1) process for a — 1 and different values of i 



plot. If Vmin is not Small enough, then the plateau may 
remain outside the graphic. 

As a global characteristic of the AR(1) power spectrum 
we introduce the difference of its extreme values, quantity 
which we call the spectrum amplitude and is denoted by 
A. For I' g [0,0.5] the spectral density pO]) is monotonic 
and its extreme values occur at v — and v = 0.5. Using 
dm) and 



/(0.5) - 



27r(l 



we have for the spectrum amplitude 



A=|/(0)-/(0.5)| 



(1-02)2 



(14) 



(15) 



The extreme values of the power spectrum (rT2|) and ([14]) 
become equal for (f) = when the power spectrum is a 
line parallel with Ox axis and ^ = 0. One can see that 
for (j) ^ 1, both /(O) and A tend to infinity. 



In Fig. [3] we present the variation of the power spec- 
trum with respect to cj). Although in linear coordinates 
the power spectrum corresponding to —0 is the reflec- 
tion of that corresponding to </> with respect to a line 
parallel to Oy axis, in log-log scale they have very differ- 
ent shapes. This difference occurs because, as shown in 
Fig. [21 the small frequency region is stretched whereas 
that of large frequency is compressed. In accordance 
with for > the plateau height /(O) increases 

with (f> and the extreme region for large frequencies of 
the power spectrum /(0.5) given by (|14p has smaller val- 
ues for smaller cf). 

From Fig. [Sji and Fig. ^ it results that the AR(1) 
processes have some fractal features. For cf) = 0.9 and 
especially for cj) = 0.99, a large region of the power spec- 
trum is linear with a slope near —2. Also for small values 
of (j> (for example (p = 0.5 in Fig. [SJa) a significant region 
of the power spectrum can be considered linear (fractal). 
In order to compute the slope of the power spectrum 
for arbitrary 0, we denote by ^ = log a; and rj = logy 
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FIG. 4: The absolute value of the slope of the AR(1) power 
spectrum for a = 1 and different values of 0. 

the double-logarithmic coordinates such that a function 
y = f (x) is written in the new coordinates as 

77 = logio / (10«) . 
The slope of the log-log plot is 

= (In /(.)). 

If we apply this relation to the function (|10p . we obtain 
the slope of the AR(1) power spectrum 

^(-^^)^- l + /-20cos2.. - (16) 

In Fig. 2] we have plotted the absolute value of this func- 
tion in log-log scale and we observe that for (j) > 0.9 there 
exist values of (3 near —2. We can verify this behavior 
substituting = 1 in ^TE\i 

(3{y] 1) — —2tti/ cotiru . 

Obviously this case is artificial because for (/) = 1 we ob- 
tain the Brownian motion, not the AR(1) process. Then 
we have limj/_,o Pi^^j 1) = ~2 which corresponds to the 
plateau in Fig.|ll lf(f><l, then /3(0; (f>) ^ and in Fig.g] 
the curve is decreasing for small frequencies. For cj) < 0.9 
there is only one maximum value for (3 that corresponds 
to the center of the " linear" (fractal) region of the power 
spectrum. 

IV. FINITE AR(1) PROCESS 

The time series appearing in practice have a finite 
length and usually they are considered finite samples of 
an AR(1) process of infinite length. The first terms of 
the sample are correlated with the preceding terms of 



the realization which has not been recorded. But the 
first terms of a numerically generated time series can not 
be related with realizations of other preceding random 
variables. Therefore, a numerically generated time se- 
ries is never strictly a realization of a finite sample of an 
ideal stationary stochastic process of infinite length. For 
instance, the index t in relations ([T]) and ^ cannot be 
an arbitrary integer. Because the relations defining the 
process are recursive, the first terms must be defined by 
additional relations. As we shall show in the following, 
the manner in which these additional relations are cho- 
sen can essentially modify the properties of the stochastic 
process. We shall call finite AR(1) process a stochastic 
process of finite length satisfying a recursive relation ([1]) . 

Let T denote the length of a finite AR(1) process, that 
is t = 1,2,...,T. The first term Xi must be chosen in- 
dependently and then we obtain another process instead 
of that studied in the previous section, denoted by {Xt\. 
Because Xt satisfies the relation for i > 1 , if we apply 
this relation successively we can express the terms of the 
stochastic process as a finite sum 

Xt^Zt + (t)Zt-i + .... + 0*-2^2 + (tf'^Xi. (17) 

In the following we consider only the causal AR(1) pro- 
cesses, i.e., we suppose |0| < 1. As shown in the previous 
section, the acausal process is equivalent with a causal 
one generated in reverse order. 

If Xi is a Gaussian random variable with variance ai 
and zero mean, then from (|17p it follows that Xt is the 
sum of t Gaussian random variables, hence it has also a 
Gaussian distribution with variance 

^2 2 /i I /2 I /4 I I ±2{t-2)\ I ^2 ;2(t-l) 

at ^ a 11 + +0 + ... + (p ^ ' j + a^cp ^ ' . 

Applying the formula for the sum of a geometric series 
we have 

a,^=a,^ + (a?-a,^)0^(-^ (18) 

where we have used ([7]). The variance of the finite AR(1) 
process has a constant term equal with the variance of 
the infinite AR(1) process ([7]) and a variable term which 
tends asymptotically to zero because |0| < 1. In this 
case the finite AR(1) process is nonstationary presenting 
transient effects, i.e., its variance approximates the theo- 
retical one at — as only after a time interval Iq for which 
(/)^*° can be neglected. 

A. Quasistationary finite AR(1) process 

For ai = as the variable term in (jlSp vanishes and 
at = as for all t ^T. Hence, if for a finite AR(1) process 
we choose Xi = {as/a)Zi, then all the terms have the 
same variance. This choice is natural because it is more 
reasonable to take the first term of the finite AR(1) pro- 
cess similar to the stationary infinite AR(1) process and 



6 



not to the white noise. Because for ai ^ Og the calcu- 
lations become more complicated, we deal only with the 
case CTi = Os- 

Let us show that for cti — Os the properties of the 
finite AR(1) process are very identical to those of a fi- 
nite sample of a stationary infinite AR(1) process. The 
autocovariance function 7(t; t) = E{XtXt-T} can be cal- 
culated only if |t| < T and t < t ^ T + t. Unhke the 
autocovariance function ([5]) the quantity 7 (t; t) does not 
depend only on t since it exists only for certain values 
of t. Therefore {Xt} is not a stationary stochastic pro- 
cess in a strict mathematical meaning. However, when it 
exists, we can show that E{XtXt-T} — 4'E{Xt-iXt-T} 
proceeding in the same way as for Then instead of 
(IHl) we obtain 



7(r;t) = 0^ 



(19) 



If we choose di = Us, then dt-r — <^s is constant and 
when 7 (r; i) exists it is identical to the covariance func- 
tion 7 (r) in ([5]). Hence, if we want to numerically model 
a stationary infinite AR(1) process, then we have to use 
a finite AR(1) process {ATt} with cti = g^. 



B. Brownian motion 

Let us analyze now the finite AR(1) process satisfying 
for 0=1. This is the well known Brownian motion. 
In this case X^ — and then ([TT)) becomes 



X, 



Zt-i 



Z2 + ZI. 



(20) 



Because Xt is the sum of t gaussian random variables, it 
results that its variance is the sum of the variances of the 
terms of the sum 



<Jt — ta . 



If we write the relation (1201) in the form 



(21) 



Xt+T — Zt+T + ••• + Zt+i + Xt , 

multiply it with Xt and take the mean, then we obtain 

E{Xt+rXt} = ^ ta^ . (22) 

The relation between the Brownian motion and the 
quasistationary finite AR(1) process can be clarified if in 
we take ai — a corresponding to the choice of the 
first term for the Brownian motion Xi = Z\ 



dl = al (1 - 0^*) 



(23) 



Figure S] shows the variation of CTj for different values of 
0. For a given (/), at the beginning there is a nonstation- 
ary transient period before the stationary state of the 
AR(1) process is reached. As tends to 1, the transient 
region is expanded and at the limit it becomes infinite. 
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FIG. 5: The standard deviation of a finite AR(1) process for 
different values of <j!> when the first term coincides with the 
white noise cti = a. The transient region extends when 
takes greater values. 



such that for </> = 1 an entirely nonstationary process is 
obtained, i.e., the Brownian motion. So the Brownian 
motion corresponds to the transient region extended to 
the infinity, whereas the stationary infinite AR(1) process 
corresponds to the stationary part of the graph. There- 
fore to obtain a quasistationary finite AR(1) process for 
(\) very close to 1 the only possibility is to choose a\ = Gs 
completely eliminating the transient region. 



V. PERIODOGRAM 

For a finite AR(1) process the definition ([9]) can not 
be applied. Therefore we use the periodogram which is 
defined as the square of the absolute value of the discrete 
Fourier transform of the stochastic process of finite length 
p^ . Here we consider only a finite equidistant set of 
frequencies for which we define the amplitude 



1 ^ ^ 



t4*~'^^""'\ n=l,2,...,T, (24) 



where lot — exp (— 27ri/r). The corresponding terms of 
the periodogram are 

|2 



In = l^n 

Replacing ([24| in ((25| we have 

T T 

T 



(25) 



T T 



(t-l)(n-l) ^ 



Because ^lo, 



vj, ujrj. — exp { — ^ (t ~ s)}, we introduce 



a new variable t = t — s and then 

T , T-1 



■ " " t=l 

(26) 



T = l 
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The terms 7„ of the periodogram are random variables 
and their mean E {/„} tends to the spectral density f{v) 
given by (jlOp when T — > oo [13] . We shall show this prop- 
erty only for the two particular cases considered in the 
previous section for which the calculations are shorter. 



A. The periodogram of the quasistationary finite 
AR(1) process 

According to the analysis in the previous section, if 
CTi = (Ts, then E{Xl} = a1 and E{XtXt+T} = cr^./)"' and 
the average of relation (pS)) reads 



T-l 



E{Ir.}^al + -alY.{T 



' UJ, 



-r(n-l) 



The sums in this formula are equal to 



T-l 



xT 



T = l 



{i-xY 



(27) 



where x = 0^^^" ^\ Since the first term is proportional 
to T, it is larger than the second term, therefore we write 
the periodogram mean as a sum of a dominant term and 
a correction 



E{In} = 



1 - 2(/)Cosf^(n - 1) 



;{l + Pn). (28) 



When the correction p„ can be neglected, this formula is 
an approximation of the spectral density of the stationary 
infinite AR(1) process pO| 



~27r/ (i/„), 

where Vn = {n— 1) /T. Since ([28|) is a periodic function, 
we shall consider for the index n only the values n = 
1,2, [(T+ l)/2], where [•] is the integer part function, 
so that Vn e [0, 0.5]. Relation (|28p can be written as well 
as 



E{In} = 



(1- 



) Sm TTVn 



-(1+Pn) 



(29) 



Now we shall analyze the dependence of the correction 
Pn on the parameters n, T and (j). Taking into account 



that in ^ 



from a direct computation it fol- 



lows that Pn can be written as a product of two factors 
depending each of them only on two of the three param- 
eters 



where 



Pn = r((/), T) r]{(j),Vn) , 

1 2<^(1 - 0^) 



b,T) 



T 1 - 



(30) 



(31) 



and 



77(0, j/„) = 



2</.- 



^) cos27rt'„ 



1 



20 cos 27ri/„ 



(32) 



The derivative of the function rj with respect to Vn in- 
dicates that it is monotonic increasing for any fixed value 
4> € (—1, 1). For the extreme values of fn, the function 77 
is independent on the values of 0, i.e., 77(^,0) = —1 and 
77(0,0.5) — 1. In Fig. [5] we have plotted 77 with respect 
to i/„ for different values of 0. For = the function 
reduces to a cosine function 77(0, Vn) = — cos27rt'„ which, 
as 101 increases, is distorted into a constant function, i.e., 

±1 . (33) 



lini 7y(0,7/„) 

2)— >±1 



The absolute value of this factor is always smaller or 
equal to 1. 

The second factor in the correction ([50)1 given by (PT]) 
is plotted in Fig. [6] for > and a few values of T. It is 
a monotonic increasing function with respect to and 



lim r( 



,T) = 1 



(34) 



From ([55]) and ([M)) it follows that when 0^1 the cor- 
rection (|30p is also approximately equal to 1, so that 
the approximation ([28|) of the AR(1) power spectrum is 
wrong in the very dominant order. Reversely, for a given 
value of 0, the relation PT|) allows us to find the value of 
T so that the correction r should have the desired value. 

If T is even, then these conclusions hold for < too, 
since r changes only its sign r{—(j),T) = —r{(j),T). But 
if T is odd, then 0-^" changes its sign and the function 
r(0, T) acquires a different form. The most important 
modification is that, for ^ —1 the factor r becomes 
infinite. Thus, in this case, the periodogram of the qua- 
sistationary finite AR(1) process is completely different 
from the power spectrum of the stationary infinite AR(1) 
process. 

If the length T is large enough such that the cor- 
rection Pn in ((29| could be neglected, then the graph- 
ical representation of the finite AR(1) power spectrum 
is identical to that discussed in Section IIIII For exam- 
ple, when T — 1000 and — 0.9 the correction (|30p is 
Pn = 0.009577(0, 7/„) < 0.0095 and it can be neglected. 
But for T = 1000 and = 0.99 we have a much greater 
correction p„ = 0.0995 77(0, Vn)- In Fig.lHlone can see that 
for near 1, the factor 77 is approximately 1 excepting 
for very small frequencies. Therefore the correction r is 
constant for almost all frequencies and the periodogram 
differs from the spectral density pU|) by the constant 
factor 1 + Pn- In log- log scale this constant factor shifts 
the periodogram parallel to the AR(1) power spectrum 
(see Fig. El). 

Because vi = 0, in a log-log scale the minimum fre- 
quency for a periodogram of a finite AR(1) process is 
1^2 = 1/T. Then the condition that the periodogram has 
a plateau can be obtained from (fie 



27rV0 



(35) 
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FIG. 7: The periodogram of an finite AR(1) process witii 
T = 100 and (j) = 0.99 (point markers) in comparison witii 
tlie power spectrum of an infinite AR(1) process witii tlie 
same (continuous line). 



For example, when — 0.99 we have T ^ 600 and in 
Fig. [7] one can see that for T = 100 the periodogram has 
no plateau. 



B. The periodogram of the Brownian motion 



After some calculations we obtain 



(^(n-1)) 



(f(n-l)) 2sin2 (f (n- 1)) 



(37) 



The dominant term in ((37|) is different from that in ([291) 
for (j) = l only by the factor T/2. The relation ^ does 
not hold for n = 1 because in the calculations we used 
relations incompatible with that special value. If in (|36p 
we take n = 1, then 

2 

E{Ii} = — {T+1){T^ -T + 3) . (38) 

In Fig. [5] we have plotted the dominant term of the 
periodogram ((37)) for T — 1000. The most part of the 
graphic is a straight line since, if in (|37p we consider 
n T, then E {In} oc ti^^. So in a log-log scale we ob- 
tain a straight line with the slope —2 and since the small 
frequencies region is strongly delated the most part of 
the graphic has this property. Figure [8] shows that out- 
side of the plateau, the periodogram of the Brownian 
motion is parallel to the periodograms of quasistationary 
finite AR(1) processes with close to 1 and the distance 
between them equals log(T/2) as shown above. This be- 
havior is due to the fact that for 1 — (/) <C 1 the value of 
the sine function at the denominator in (|29p is dominant. 
Only for Vn small enough the quantities ([29| and ([37)) are 
significantly different. 



The periodogram of the Brownian motion is obtained 
by replacing (|2T)) and (|22)) in the formula resulting by 
averaging (|^ 



E{In} 



T=l 



(36) 



VI. CONCLUSIONS 

Although the finite and infinite AR(1) processes are 
defined by the same recurrence relation, their properties 
can be very different when the serial correlation is large 
and the length of the finite AR(1) process is small. This 
difference is minimized if the first term of the finite AR(1) 
process is chosen such that its standard deviation should 
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FIG. 8: The periodogram of the Brownian motion in com- 
parison with the periodograms of the quasistationary finite 
AR(1) process with = 0.9 and 0.99. 

be equal to the standard deviation of the infinite AR(1) 
process. However, even in this case the periodogram of 
the finite AR(1) process for (/) close to ±1 can significantly 
differ from the power spectrum of the infinite AR(1) pro- 
cess. That is why to numerically generate a time series 
as a realization of an AR(1) process we must take into 



account that the series length must be larger than the 
threshold value ([55]) . 

Although the AR(1) process is the simplest stochastic 
process describing the serial correlation only by means 
of a single parameter, it has remarkable properties which 
make it very useful as a first step in time series model- 
ing. However, one has to take care that it is only one in 
the infinity of existing stochastic models and it is pos- 
sible that an autoregressive structure to be incorrectly 
assigned to a time series. For example, although the au- 
tocovariance function ([8]) has an exponential decay, some- 
times one attempted to model a 1// noise characterized 
by a power law decay with autoregressive processes [l7| , 
[ISj . Therefore, it is necessary a thorough analysis of the 
AR(1) process properties not only in its infinite idealized 
form, but in the finite one as well. If the time series is not 
long enough, it is very likely that essential characteristics 
of the AR(1) process should be lost, as for example the 
existence of the plateau at small frequencies, and misin- 
terpretations can occur. 
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